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(54) Method and apparatus for configuring fabrics within a fibre channel system 

(57) A method and apparatus for configuring a sys- 
tem that includes a plurality of interconnected compo- 
nents (2, 4. 6; 40-45; 51-57; 132) that each supports 
service parameters for communicating with other com- 
ponents in the system. A determination is made as to 
which components support service parameters that are 
compatible, and groups of components having compati- 
ble service parameters are identified. Adjacent compo- 
nents exchange information frames that identify their 
service parameters. Each component compares its serv- 
ice parameters with those of its adjacent components to , 
determine whether they are compatible, updating its own 
service parameters if necessary. Any component that 
updates its service parameters issues another informa- 
tion frame. Thus, information frames are exchanged until 
it is determined which components support compatible 
service parameters, and what service parameters are to 
be used for communicating among those components. ^ 
Additionally a unique address is automatically assigned 
to every port in the system. Control over the entire range 
of available addresses is initially granted to a master 
component, which assigns unique addresses to its own 
ports, and then relinquishes control over ranges of 
addresses to other components which each becomes 
the managers of the addresses over which it is granted 
control. Each address manager assigns unique 
addresses to its ports, and if any extra addresses are 
available, relinquishes control over those extra 
C\J addresses to another component. 
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Description 

Field Of The Invention 

This invention relates to the configuration of fabrics s 
within a Fibre Channel system. More particularly, this 
invention provides a method and apparatus for distribut- 
ing service parameters among a number of fibre channel 
switching elements to determine and define the config- 
uration of a Fibre Channel system, and for partitioning 10 
addresses among a plurality of ports in the system. 

Background Discussion 

Computers and computer peripherals (collectively is 
"devices") generally include at least one input/output 
(I/O) channel that allows communication with other 
devices. Traditional I/O channels support only a single 
protocol (e.g., SCSI, IPI. proprietary protocols, etc.). 
Thus, to provide a computer or peripheral with the ability 20 
to communicate with other devices using multiple proto- 
cols, multiple I/O channels were traditionally required, 
each having hardware to support its associated protocol. 
Often, the hardware necessary to support even a single 
protocol can be significant in terms of both cost and phys- 25 
ical space. Thus, the use of multiple I/O channels is dis- 
advantageous. 

Fibre Channel is a computer-to-peripheral or com- 
puter-to-computer multi-protocol networked I/O channel 
that has been proposed to overcome the disadvantages 30 
associated with using multiple single-protocol I/O chan- 
nels. An interface standard for Fibre Channel has been 
proposed by the American National Standard for Infor- 
mation Systems, and a working draft which is incorpo- 
rated herein by reference, is entitled FIBRE CHANNEL- 35 
PHYSICAL AND SIGNALLING INTERFACE, rev. 4:3, 
June 1, 1994 (hereafter "FC-PH"). Fibre Channel spec- 
ifies a variety of communication protocols, data rates and 
physical media interface types (e.g., optical, coaxial, 
twisted pair wires) to meet the needs of peripheral and 40 
computing devices in their support of multiple I/O proto- 
cols. 

Fibre Channel supports a number of different topol- 
ogies, each defining the manner in which a system of 
devices can be networked together. These topologies 45 
include, for example, direct one-to-one connection 
between two devices, a loop topology, and a fabric topol- 
ogy. A fabric is a network of switches for interconnecting 
a plurality of devices without restriction as to the manner 
in which the switches can be arranged, and can include so 
a mixture of other topology types. 

Because Fibre Channel sought to support multiple 
communication protocols and a fabric topology, prob- 
lems were encountered that had not been faced with 
conventional networks and I/O channels. Fibre Channel ss 
allows the interconnection of multiple switches, each 
potentially supporting multiple protocols, in an unre- 
stricted fashion in a single system. Thus, the potential 
exists in Fibre Channel for two or more devices to be con- 



nected to the same system, despite the fact that they 
cannot communicate because they are incompatible. For 
example, two devices may be incompatible because they 
cannot support a common data rate or data frame size 
for communicating therebetween. Thus, a technique was 
needed to determine which switches and devices could 
communicate with one another in a Fibre Channel sys- 
tem, and which could not. 

Furthermore, because multiple communication pro- 
tocols are supported by Fibre Channel, some technique 
needed to be developed to determine what service 
parameters would be used by the switches and devices 
in any system that were compatible, to ensure that each 
used common service parameters during inter<levice 
communication. 

Fibre Channel supports automatic address assign- 
ment wherein each fabric automatically assigns a unique 
address to each port irtthe fabric. Thus. some technique 
also needed to be developed for partitioning addresses 
among a plurality of switch and device ports in a Fibre 
Channel system. 

The present invention is directed to a method and 
apparatus for solving the above-described problems. 

Summary Of The Invention 

The foregoing problems are overcome in one illus- 
trative embodiment of the invention in which a method 
and apparatus are provided for configuring a system that 
includes a plurality of interconnected components, each 
component supporting service parameters used in com- 
municating with other components in the system, the plu- 
rality of components including at least two components 
whose service parameters differ. A determination is 
made as to which components support service parame- 
ters that are compatible for communication across the 
system, and groups of components that have compatible 
service parameters are identified. 

In another illustrative embodiment of the invention, 
the determination as to which components supporttx>m- 
patible service parameters is made by exchanging infor- 
mation frames between components that are adjacent 
one another in the system, the information frames iden- 
tifying the service parameters of the components. Each 
component compares its service parameters with those 
of its adjacent components to determine whether they 
are compatible, updating its own service parameters if 
" necessary. Whenever a component's service parame- 
ters are updated as a result of a comparision with those 
of another component, the updating component issues 
another information frame identifying its updated service 
paramters. In this manner, information frames are 
exchanged between adjacent components until a deter- 
mination is made as to which components in the system 
support compatible service parameters, and as to what 
service parameters will be used for communicating 
among those components. 

In a further illustrative embodiment of the invention, 
a method and apparatus are provided for automatically 
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assigning a unique address to every port in a system that 
includes a plurality of interconnected components, each 
component having at least one port, the unique 
addresses being selected from a range of available 
addresses. Control over assignment of the entire range 5 
of available addresses is initially granted to a single mas- 
ter component. The master component assigns unique 
addresses to each of its own ports, and then relinguishes 
control over ranges of addresses to other components, 
which then become the managers of the addresses over w 
which they are granted control by the master. Each com- 
ponent that acts as an address manager assigns unique 
addresses to its ports, and if it has any extra addresses 
available, relinqueshes control over those extra 
addresses to another component that becomes the man- 75 
ager of those addresses. In this manner, control over the 
available addresses is distributed among the compo- 
nents in the system, which assign a unique address to 
every port. 

20 

Brief Description Of The Drawings 

Fig. 1 is a block diagram of an example of a Fibre 
Channel system; 

Figs. 2(a)-(d) show the manner in which the distrib- 2s 
uted service parameter (DSP) procedure results in 
an updating of the fabric name for each fabric ele- 
ment in a system; 

Figs. 3(a)-(b) respectively show the manner in which 
the Max. and Min. resource allocation time out vat- 30 
ues (R_A_TOV) for a fabric element issuing a DSP 
reguest are compared with the fabric-wide service 
parameters of the responding fabric element; 
Figs. 4(a)-(b) respectively show the manner in which 
the Max. and Min. error detect time out values 35 
(E_D_TOV) for a fabric element issuing a DSP 
request are compared with the fabric-wide service 
parameters of the responding fabric element; 
Fig. 5 shows the manner in which the maximum 
round-trip time value (MRTT) for a fabric element 40 
issuing a DSP request is compared with the fabric- 
wide service parameters of the responding fabric 
element; 

Figs. 6(a) -(b) respectively show the manner in which 
the Max. and Min. data field sizes are compared for 45 
the requesting and responding fabric elements dur- 
ing a DSP request; 

Figs. 7(a)-(f) show the manner in which subfabrics, 
regions and extended regions can be formed for a 
single fabric; 50 
Figs. 8(a)-(b) show the manner in which the priority 
levels are updated and determined for region-wide 
service parameters; 

Fig. 9 shows an illustrative example of various 
region-wide service parameters and whether or not ss 
they are provided in each of service classes 1 -4; 
Figs. 1 0(a)-(c) show an illustrative example of a data 
frame organization for a DSP request to establish 
fabric-wide and region-wide service parameters; 
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Fig. 11 is a flowchart of a method executed by each 
fabric element during the DSP procedure; 
Fig. 12 is an illustrative 24-bit address partitioning 
for one embodiment of the invention; 
Fig. 13 is a hierarchical representation of address 
partitioning using domains, areas and ports as well 
as address managers for each; 
Fig. 14 is a block diagram of an illustrative fabric ele- 
ment; and 

Fig. 1 5 is a table showing the manner in which a fab- 
ric element receiving a validate name data frame 
responds thereto. 

Detailed Description Of Illustrativ e Embodiments 

Fibre Channel supports five different service 
classes that can be employed to communicate between 
devices and/or switches in a system, i.e., service classes 
1 -4 and R These service classes are defined in detail in 
the FC-PH document that establishes the Fibre Channel 
standard. Briefly, service class 1 establishes a dedicated 
connection between two devices, and the connection is 
retained and guaranteed by the fabric. Service class 2 is 
a connectionless service with the fabric multiplexing 
frames at frame boundaries. The device provides 
acknowledgment of delivery or the fabric provides notifi- 
cation of failure to deliver transmitted frames. Service 
class 3 is also a connectionless service with the fabric 
multiplexing frames at frame boundaries, but supports 
only unacknowledged delivery. Service class 4 estab- 
lishes a pair of unidirectional virtual connections 
between two devices, and the virtual connections are 
retained and guaranteed by the fabric. In class 4, the fab- 
ric guarantees a fraction of the available bandwidth 
between the devices involved in each virtual connection. 
Service class F is a connectionless service that is 
restricted to use only by fabric elements (i.e., switches) 
when communicating with each other. 

Fibre channel also supports the following four data 
rates: (1) 132.8125 MBaud; (2) 265.625 MB^ud; (3) 
531 .25 MBaud; and (4) 1 .0625 GBaud. 

Hg. 1 shows an example of a Fibre Channel system 
that includes three fabric elements 2, 4 and 6. Each fabric 
element includes a switch (not shown) having a series of 
internally connected ports, such that data into one port 
of the switch can be output from any of the other ports. 
Each of the fabric elements 2. 4 and 6 is shown with at 
least one associated E_Port and F_Port In particular, 
fabric element 2 has an associated E_Port 8, fabric ele- 
ment 4 has associated E_Ports 1 0, 1 2 and 1 4, and fabric 
element 6 has associated E_Ports 16 and 1 8. An E_Port 
is a label used to identify a port of a fabric element that 
is used to form a connection with another fabric element 
The connection between two E_Ports is established via 
an Inter-Element Unk (I EL). In Fig. 1, E_Ports 8 and 10 
are connected via IEL 20, E„Ports 12 and 16 are con- 
nected via IEL 22, and E_Ports 1 4 and 18 are connected 
via IEL 24. Each IEL supports only one of the Fibre Chan- 
nel data rates. 
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In the example Hlustrated in Fig. 1, fabric elements 
2, 4 and 6 respectively have associated F_Ports 26. 28 
and 30. An F_Port is a label used to identify a port of a 
fabric element that is used to form a connection with a 
device, such as a computer or peripheral. In Fig. 1, 5 
F_Ports 26, 28 and 30 are respectively coupled to 
devices 32, 34 and 36. 

In the system shown in Fig. 1 , a physical path exists, 
via fabric elements 2, 4 and 6, between each of the 
devices 32, 34 and 36. However, as described above, 10 
Fibre Channel allows devices to be connected to a single 
system even if they do not support compatible protocols. 
Therefore, although devices 32, 34 and 36 are con- 
nected to the same physical system, communication 
between each is not necessarily possible or desirable. 15 
Based on the service parameters supported by each of 
the fabric elements (2, 4 and 6) and their associated 
devices (32, 34 and 36), there are a number of possible 
configurations for the system of Fig. 1 . For example, the 
system may include a single fabric, wherein all of the 20 
devices can communicate using each of the service 
classes supported by Fibre Channel; as discussed 
above, a fabric is a network of switches for interconnect- 
ing a plurality of devices without restriction as to the man- 
ner in which the switches can be arranged, and can 25 
include a mixture of other topology types. Alternatively; 
the system may include a single fabric wherein one of 
the devices can communicate with the others in only a 
subset of the supported service classes. Finally, the sys- 
tem may include one or more fabrics wherein communi- 30 
cation between some of the devices is not enabled in any 
of service classes 1 -4. 

The present invention provides a method for distrib- 
uting service parameters among the fabric elements to 
determine and define the configuration of the system. 35 
The system configuration is initially determined during 
initialization. However, in a large networked system, 
devices may frequently be added or removed. Whenever 
the system is altered, the alteration could impact the 
service parameters employed by the other switches and 40 
devices in communicating over the system. Therefore, 
whenever the system is altered, it is desirable to recheck 
the configuration of the system and the service param- 
eters employed by its devices to determine whether any 
modifications should be made. It is also desirable to do 45 
so without requiring that the entire system be brought 
off-line. This result is achieved in one embodiment of the 
present invention. Furthermore, the present invention 
allows configuration of the system, and reconfiguration 
when necessary, without requiring synchronization so 
between the fabric elements, irrespective of the number 
and arrangement of elements in the system. 

In one illustrative embodiment of the present inven- 
tion, the configuration of a Fibre Channel system during 
system initialization is determined by executing a distri- ss 
bution of service parameters (DSP) procedure, wherein 
DSP requests are issued from all fabric elements in the 
system. Each fabric element issues a separate DSP 
request for each of its associated E_Ports. Each DSP 
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request includes information defining the service param- 
eters that the requesting fabric element wishes to sup- 
port. This information is transmitted over the IEL that 
connects the E_Port of the requesting fabric element to 
a responding fabric element. The responding fabric ele- 
ment compares the service parameters of the requester 
with its own, to determine whether they are compatible, 
and sends an acknowledgment data frame to the 
requester specifying the service parameters of the 
responder. If necessary, the responding fabric element 
revises its own service parameters to be compatible with 
those of the requester, and issues a DSP request of its 
own with the updated service parameters. The updated 
service parameters are received by the fabric element 
that issued the original DSP request, and may prompt 
that fabric element to also modify its service parameters 
to achieve compatibility; this iterative process is dis- 
cussed in more detail below. The responding fabric ele- 
ment also issues a DSP request with its updated service 
parameters to every other fabric element to which it is 
directly connected via an IEL. 

Within a single fabric, devices and fabric elements 
may be grouped into smaller subfabrics, which may in 
turn be subdivided into regions. Devices and fabric ele- 
ments within a subfabric and region share some com- 
mon characteristics that may not be shared by every 
device and element in a single fabric. The present inven- 
tion determines the configuration of the system in terms 
of the number and arrangement of fabrics, subfabrics 
and regions, through the use of the DSP procedure. The 
particular service parameters used to define a fabric, any 
subfabrics within a fabric, and any regions within a sub- 
fabric are discussed in more detail below. For the pur- 
pose of explaining the DSP procedure and the way it is 
used to determine the configuration of the system, the 
following explanation is provided referring only to a single 
fabric-wide service parameter, i.e^. the fabric name. The 
other service parameters are determined in a similar 
fashion as discussed below. 

The fabric name is a unique number us^d to 
uniquely identify the fabric. Conventionally, devices in a 
network are provided with unique names or identification 
(ID) numbers to uniquely identify each device for various 
network management functions. For this purpose, the 
Institute of Electrical and Electronic Engineers (IEEE) 
provides a service wherein a user can purchase a block 
of numbers that can then be assigned to the purchaser's 
devices and switches that are to be connected to a net- 
work. Separate numbers are assigned to each port of 
each device and switch. When this service is employed 
by all users of a network, it is ensured that no two ports 
on the network will have the same ID number. 
Similarly, it is desirable for network management pur- 
poses to identify all of the fabric elements in the system 
that belong to the same fabric, and to adopt a unique 
name for each fabric. 

In accordance with the present invention, each fabric 
is named by adopting the ID number of one of the fabric 
elements within the fabric as the name for the entire fab- 
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ric. In the particular embodiment of the invention 
described below, the fabric adopts as its name the lowest 
ID number of any of its associated fabric elements. How- 
ever, it should be understood that other techniques can 
alternatively be employed, such as selecting the highest 5 
ID number. 

During initialization, each fabric element initiates a 
separate DSP request from each of its E_Ports, across 
its associated IEL, to an adjacent fabric element. In the 
illustrative system shown in Fig. 1 . the following six DSP 10 
requests would be initiated: (1) a DSP request initiated 
by fabric element 2 and destined for fabric element 4 
across IEL 20; (2) a DSP request initiated by fabric ele- 
ment 4 and destined tor fabric element 2 across IEL 20; 
(3) a DSP request initiated by fabric element 4 and des- is 
tined for fabric element 6 across IEL 22; (4) a DSP 
request initiated by fabric element 4 and destined for fab- 
ric element 6 across IEL 24; (5) a DSP request initiated 
by fabric element 6 and destined for fabric element 4 
across IEL 22; and (6) a DSP request initiated by fabric 20 
element 6 and destined for fabric element 4 across IEL 
24^ Each DSP request includes, (inter alia), data identi- 
fying the current ID number of the initiating fabric ele- 
ment. When a fabric element receives a DSP request, it 
compares the ID number of the requester with its own. If 25 
the ID number of the requester is greater than the ID 
number of the responder. the responding fabric element 
does not update its ID number, and responds by trans- 
mitting an acknowledgment data frame to the requester 
with the responder's ID number. If the responding fabric 30 
element has an ID number that is greater than that of the 
requester, the responding fabric element updates its ID 
number to adopt that of the requester, prior to sending 
the acknowledgment data frame. The responding fabric 
element then transmits its own DSP request to the 35 
requester, indicating the adopted ID number and its other 
service parameters. 

In addition to initiating a DSP request at initialization, 
each fabric element also initiates additional DSP 
requests whenever its service parameters are modified. 40 
For example, if a fabric element updates its fabric name 
as a result of a DSP request initiated by another to adopt 
the name of the requester, the fabric element will initiate 
an additional DSP request to each of its adjacent fabric 
elements, and the new request will include the newly 45 
adopted fabric name. Thus, the fabric name and other 
service parameters of the fabric elements will be contin- 
ually and automatically updated until a stable condition 
is reached. A stable condition is reached when the last 
DSP request initiated by any fabric element does not so 
result in a change in the service parameters of any of its 
adjacent fabric elements. For the above-described 
example in which the fabric name is determined, the sta- 
ble state is reached when each of the fabric elements in 
a single fabric has adopted the same fabric name. After ss 
initialization, the DSP procedure operates in the back- 
ground so that the system continues to operate while the 
DSP procedure is running. It is not until the DSP proce- 
dure is completed and a stable condition has been 
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reached that the affected fabric elements and devices 
are taken off-line. The affected devices are taken off-line 
so that they can be re-initialized to establish new service 
parameters. For example, if a device is connected to a 
port of a fabric element that determines that the data 
frame size to be used by the region to which the device 
belongs should be updated as a result of the DSP pro- 
cedure, the device is taken off-line and re-initialized so 
that it will employ the updated data frame size in com- 
municating with other devices over the system. 

rf a device connected to a fabric element port 
becomes inactive or is removed from the system, the 
system manager has the option of altering the service 
parameters of the fabric element port If a device is being 
moved temporarily, the system manager may choose to 
leave the service parameters of its associated fabric ele- 
ment port unchanged, so that it will not be necessary to 
invoke the DSP procedure, which could potentially alter . 
the system's service parameters and require taking at 
least some of the system devices off-line for reinitializa- 
tion. However, if for any reason the system manager 
determines that it is desirable to update the service 
parameters of the fabric element port associated with the 
device, he may do so, triggering operation of the DSP 
procedure. 

In one embodiment of the invention, the stable con- 
dition for the DSP procedure is recognized independ- 
ently by each fabric element in the system. After sending 
a DSP request each fabric element sets a timer indicat- 
ing a time period during which the fabric element would 
expect to receive a DSP request from smother if the serv- 
ice parameters that the fabric element had adopted and 
sent out in its last DSP request caused any other fabric 
element in the system to modify its fabric-wide service 
parameters. When the timer expires without another 
DSP request having been received, the fabric element 
assumes that the stable condition has been reached. It 
is desirable to have this time period be sufficiently long 
so that users are not interrupted by taking their devices 
off-line to update the service parameters until those 
parameters have become stable. However, it is not par- 
ticularly harmful rf one or more fabric elements resume 
processing prematurely before the service parameters 
have actually stabilized, because the devices connected 
to the fabric elements win simply operate based on the 
existing service parameters. When a subsequent DSP 
request received by the fabric element results in a 
change of its service parameters, the fabric element and 
Hs associated devices will simply be taken off-line again 
and reinitialized with the new service parameters. 

Figs. 2(a)-{d) illustrate, using the fabric name exam- 
ple, how the service parameters are rteratively updated 
as a result of the above-described DSP procedure. Figs. 
2(a)-(d) illustrate a Fibre Channel system that includes 
six fabric elements 40-45. In Fig. 2(a), the unique ID 
name for each fabric element is shown, with the lowest 
ID name belonging to fabric element 40. Fig. 2(b) shows 
the updated state of the fabric element names that 
results from one pair of DSP requests being transmitted 
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between each pair of adjacent fabric elements. The fab- 
ric name of the element within each adjacent pair that 
initially had the higher ID name is updated as a result of 
the initial DSP requests to adopt the lower ID name of its 
neighbor. 

Each fabric element that has its ID name updated in 
Fig. 2(b) initiates an additional DSP request with its adja- 
cent fabric elements, resulting in further updating of the 
fabric names associated with some of the fabric ele- 
ments as shown in Fig. 2(c). One of the fabric elements 
whose fabric name is updated in Fig. 2(c) is fabric ele- 
ment 42. As a result, fabric element 42 initiates another 
DSP request with its adjacent fabric elements 41 and 43. 
The DSP request with fabric element 41 does not result 
in any change to the fabric name of either element 41 or 
42. However, the DSP request with fabric element 43 
results in an updating of the fabric name of that fabric 
element to adopt the lower ID name (001) of fabric ele- 
ment 42 as shown in Fig. 2(d). 

As seen from Figs. 2(a)-(d). the DSP procedure of 
the present invention allows for the adoption of a com- 
mon service parameter, a fabric name in the illustrated 
example, among each of the fabric elements in the sys- 
tem. Figs. 2(a)-(d) are presented merely to illustrate the 
manner in which the DSP procedure results in an auto- 
matic updating of each of the fabric elements in the sys- 
tem. However, it should be understood that the DSP 
procedure is not required to operate in a synchronous 
manner and to proceed in any particular order. The DSP 
procedure operates without requiring synchronization 
between any of the fabric elements. The order and timing 
of the DSP requests initiated by the various fabric ele- 
ments is immaterial. The DSP procedure will result in a 
consistent adoption of service parameters for each of the 
fabric elements in the system regardless of the order and 
timing in which the DSP requests are initiated. 

In one embodiment of the present invention, each 
fabric element is also provided with a fabric name priority, 
in addition to its ID name. When the fabric name priority 
feature is used, the name adopted for the fabric will cor- 
respond to the ID name of the fabric element within the 
fabric that has the highest name priority. Amongst 
devices having the same priority level, the determination 
of the fabric name is made based upon a further refine- 
ment scheme, such as using the highest or lowest ID 
name in the manner described above. 

The fabric name priority feature enables some man- 
agement control over which fabric element will be 
selected to provide the fabric name. In network installa- 
tions, some elements may be key components, while oth- 
ers are less important for various reasons, such as 
infrequency of use or lack of reliability. The fabric name 
priority enables the system manager to influence which 
element will have its ID name adopted as the fabric 
name, so that a reliable or otherwise desirable element 
will be selected. As discussed above, whenever a system 
service parameter is changed, any device or switch in 
the system that is impacted by the change is taken off- 
line, and then reinitialized to update its service parame- 



ters. The fabric name is a service parameter that impacts 
every element in the fabric, because each stores the fab- 
ric name of the fabric to which it belongs. Thus, whenever 
the fabric name is changed, every device and switch in 

5 the fabric is taken off-line and reinitialized. If the fabric 
element from which the fabric took its name is removed 
from the system, the name of the fabric should be 
changed, because the removed element could be added 
to another system and could result in a different fabric 
10 taking its name. Since it is desirable to have the fabric 
name uniquely identify the fabric, this is obviously unde- 
sirable. Thus, it is desirable to take the fabric name from 
a reliable and key element of the system, to reduce the 
likelihood that the element will fail or be removed from 
the system, thereby decreasing the likelihood of a 
change in the name of the fabric which would result in all 
of the devices and switches in the fabric be taken off-line 
and. reinitialized. If a Jess important comppnent fails or is 
otherwise removed from the system, it may have no 

20 impact on the service parameters of any other device or 
switch. Thus, the neighboring fabric elements would not 
need to send out DSP requests to any other fabric ele- 
ments, because the system's service parameters would 
not be impacted. 

25 In one embodiment of the invention/whenever a fab- 
ric element receives a DSP request, it returns an Inter 
Element Accept (IE__ACC) data frame which includes 
data indicating the service parameters of the responding 
fabric element If the service parameters of the 

30 responder are modified as a result of the DSP request, 
the modifications are made before sending the IE_ACC 
data frame. The IE_ACC data frame is sent as an 
acknowledgment signal, consistent with the Fibre Chan- 
nel standard, to provide an indication that the DSP 

35 request was received. However, it should be understood 
that the sending of the IE_ACC data frame is not neces- 
sary for the operation of the DSP procedure. DSP 
requests are issued by both fabric element ports con- 
nected together via an I EL Thus, each fabric element is 

40 provided with the service parameters of its adjacent fab- 
ric element through the DSP requests, and need hot be 
provided with this information via an I E_ACC data frame. 

The fabric-wide service parameters are established 
to be the same for every fabric element belonging to a 

45 single fabric. The fabric-wide service parameters are 
simultaneously determined using the DSP procedure 
described above in connection with the illustrative exam- 
ple of how the fabric name is determined. In addition to 
the fabric name, one illustrative embodiment of the 

so present invention employs the following four additional 
fabric-wide service parameters: (1) minimum and maxi- 
mum Error Detect Time Out Values (min. and max. 
E_D_TOV); (2) Maximum Round-Trip Time Value 
(MRTT); (3) minimum and maximum Resource Alloca- 

55 tion Time Out Values (min. and max R_A_TOV) ; and (4) 
minimum and maximum Buffer-to- Buffer Receive Data 
Field Size values. The timer values and limits on the data 
field size are defined by the Fibre Channel standard set 
out in the FC-PH document The timers may have many 
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uses. A brief description of the timer values and illustra- 
tive uses are provided below. It should be understood 
that these descriptions are not complete and are pro- 
vided merely for illustrative purposes. 

E_D_TOV can be used to define the time period in s 
which a device which sends a data frame in response to 
a request expects to receive an acknowledge signal indi- 
cating that the data frame was received. 

r_A_TOV is defined in FC-PH as being equal to 
E_D_TOV + MRTT. and defines the longest time that a 10 
frame, once it has entered a fabric, can stay in the fabric. 
Although the timer has many other uses, it may be used 
when a data frame is sourced through the fabric. The 
source device can set a timer equal to R_A_TOV and 
expects to receive an acknowledge signal before the is 
timer lapses. If no response is received, the source 
device assumes that the data frame or the acknowledg- 
ment was lost . 

In one embodiment of the invention. R_A_TOV is 
also used to establish the time limit set by each fabric 20 
element after sending a DSP request to determine when 
the fabric-wide service parameters have stabilized. In 
this embodiment, the timer is set equal to twice the fabric 
element's Min. R_A_TOV. This timer value was selected 
because it defines a relatively long time period, and 25 
should allow sufficient time for the DSP procedure to rip- 
ple through each fabric element in the system whenever 
the service parameters are being updated. It should be 
understood that although twice the Min. R_A_TOV value 
is selected in one embodiment, numerous other timer so 
values could be selected that would achieve satisfactory 
results. 

MRTT establishes the maximum propagation delay 
for a frame through the switches and links of the fabric 
and back. MRTT is related to R_A_TOV and E_D_TOV, 35 
and will generally be shorter than each. For example, the 
difference between E_D_TOV and MRTT may establish 
the amount of time that a device is allowed to determine 
whether it should send an acknowledge signal when it 
receives a data frame. Defining MRTT separately ena- 40 
blesa fabric element to determine whether its associated 
devices can respond quickly enough to satisfy R_A_TOV 
and E_D_TOV, in view of the established MRTT for the 
fabric. 

The maximum and minimum buffer-to-buffer data 45 
field sizes determine the size of the data frames trans- 
mitted through the fabric. Fibre Channel supports data 
frames ranging from 128 bytes to 2,112 bytes. Some 
devices in the system may not have hardware that sup- 
ports a frame of 2,1 12 bytes, or even a smaller frame, so 
Therefore, each fabric element may limit the maximum 
buffer-to-buffer size that its associated devices can sup- 
port. Additionally, lower performance devices that can 
support larger frame sizes may choose to set their min- 
imum buffer size to a relatively large value. This will pre- ss 
vent those devices from being grouped in a fabric with 
devices having comparatively small frame sizes, which 
could negatively impact the performance of the lower 
performance devices because they may not be able to 
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generate a large number of small frames quickly enough 
to achieve satisfactory performance. 

Although the illustrative embodiment discussed 
above provides both minimum and maximum values for 
some of the timers and the buffer size, it should be under- 
stood that a single value can alternatively be provided 
for each. Minimum and maximum values are provided in 
one embodiment of the present invention to enable a sys- 
tem manager to have some flexibility and control over the 
capabilities of other devices with which his switches and 
devices can be joined in a single fabric. It is not neces- 
sarily desirable to join together in a single fabric every 
pair of devices that can communicate at some level. For 
example, if one fabric element is connected to a high- 
speed device, the performance of the device could be 
seriously degraded if the values of certain timers were 
set too high. Therefore, although a device may be able 
to support a high timer value, the system manager may 
choose to set the maximum value of the timer for the fab- 
ric element associated with his device to a lower value. 
As a result a deliberate decision can be made to prevent 
the device from being combined in a single fabric with 
any device that could seriously impact its performance. 
The use of maximum and minimum values for the timers 
and the data f ield size allows a system manager to pro- 
vide a range of performance requirements for other 
devices with which the device to which the fabric element 
is coupled can be grouped in a single fabric. 

Figs. 3(a) and (b) illustrate the manner in which the 
above-described service parameters are compared 
when a DSP request is initiated between two fabric ele- 
ments. In each of these figures, the service parameters 
of the fabric element that responds to the DSP request 
("the Responder") are labeled B, and the service param- 
eters for the fabric element that initiated the DSP request 
("the Requester") are labeled A. More specif ically, the fol- 
lowing labels apply in Figs. 3(a)-(b) for the Requester: 
A1 = Max. R_A_TOV and A2 = Min. R_A_TOV. The fol- 
lowing labels apply for the Responder: B1 = Max. 
R_A_TOV; B2 = Min. R_A_TOV; B3 = Max. EJ>_TOV; 
B4 = Mia E_D_TOV; and B5 = MRTT. The Condition col- 
umn for the tables in Figs. 3(a) and (b) shows the possi- 
ble results of comparisons between the designated 
service parameter of the Requester, and each of the five 
above-referenced service parameters of the Responder. 
For each comparison, the three possible results (i.e.. 
Requester is greater, Requester is less than, or the two 
are equal) are shown in the Condition column. The 
results of each comparison are shewn in the Result col- 
umn. 

When the service parameter for the Requester is 
compared with the identical service parameter for the 
Responder, the result may involve an updating of the 
Responded service parameter. For example, the first 
condition tested in Fig. 3(a) illustrates that when Max. 
R_A_TOV for the Responder (B1) is greater than for the 
Requester (A1), the Responded Max. R_A_TOV is 
modified to adopt the Requester's value for that service 
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parameter. This is designated in the Result column as 
follows: B1 <~ A1. 

When the service parameter for the Requester is 
compared with a different service parameter for the 
Responder, the result will not lead to an updating of either s 
fabric element's service parameter. However, these tests 
may indicate that the compared service parameters are 
incompatible, represented as a "Reject" in the Result col- 
umn. Such a result indicates that the Requester and 
Responder will not be joined in a single fabric. 10 

The other possible results of a comparison of two 
different service parameters are: (1) an indication that 
the compared service parameters are compatible (rep- 
resented as an "Accept** in the Result column); and (2) 
and indication that the comparison is inconclusive (rep- is 
resented with a **?** in the Result column). An inconclu- 
sive result indicates that the comparison provides no 
useful information with regard to whether the compared • . . 
service parameters are compatible. Similarly, an Accept 
result indicating compatibility of the compared parame- 20 
ters, in and of itself, does not indicate compatibility of the 
Responder and Requester fabric elements, because if 
any other pair of service parameters is incompatible, the 
fabric elements will not be combined in a single fabric. 

The comparison of some pairs of service parame- 25 
ters will not result in an updating of the Responder's serv- 
ice parameters, and cannot alone lead to a conclusion 
that the compared service parameters are incompatible 
because it will always yield an inconclusive or Accept 
result. For example, the comparison shown in Fig. 3(b) 30 
between Min. R_A_TOV (A2) of the Requester and Max. 
E_D_TOV (B3) of the Responder will necessarily lead to 
either an inconclusive result, or to an Accept condition 
indicating that these two parameters are compatible. 
Since an Accept result is not determinative, the testing 35 
of these two parameters provides ho definitive informa- 
tion as to whether the two fabric elements are compati- 
ble. Therefore, these service parameters need not be 
compared. In one embodiment of the present invention, 
comparisons which cannot lead to either an updating of 40 
a service parameter or a potential Reject result are not 
done to conserve processing resources. 

Figs. 4(a)-(b) respectively show the manner in which 
the service parameters of the Responder described in 
connection with Figs. 3(a) -3(b) are compared with the 45 
Requester's Max. E_D_TOV (A3) and Min. E_D_TOV 
(A4). Fig. 5 shows the manner in which those same 
Responder service parameters are compared with the 
Requester's MRTT. Figs. 6(a)-(b) respectively show the 
comparison of the Requester's Max. data field size (A1) so 
and Min. data field size (A2) with the Responder's Max. 
(B1) and Min. (B2) data field sizes. The same format is 
used in Figs. 4-6 as was described above in connection 
with Figs. 3(a)-(b). 

The results shown in the tables of Figs. 3(a)-(b), ss 
Figs. 4(a)-(b), Fig. 5 and Figs. 6(a)-(b) are self-explana- 
tory. Generally, when a maximum value for the respond- 
ing device exceeds that of the requesting device, the 
service parameter of the responding device is updated 



to adopt the maximum limit of the Requester. Similarly, 
if the minimum value of the Responder is less than that 
of the Requester, the parameter of the Responder is 
updated to adopt the value of the Requester. In this man- 
ner, service parameters are adopted which are compat- 
ible for both the Requester and Responder. With respect 
to MRTT, this value is generally compared with twice the 
R_A_TOV or E_D_TOV values because MRTT repre- 
sents a round-trip time through the fabric, whereas the 
time out values represent paths in only a single direction. 

The MRTT value and the Max. and Min. timer values 
for R_A_TOV and E JD_TOV for each fabric element can 
initially be set to any of various values while achieving 
satisfactory system performance. The Fibre Channel 
standard in FC-PH specifies a 32-bit dock value with 1 
ms units. Thus, 1 ms is the smallest increment used for 
each of the timer values. Max. R_A_TOV has only one 
....limitation, i.e.. It should be equal to or greater than Min,_ 
R_A_TOV. In one embodiment of the invention, a default 
value for Max. 

R_A_TOV is set to 120 seconds, and a default value for 
Min. R_A_TOV is set to 1 5 seconds. In order to ensure 
that Min. R_A_TOV is sufficiently long, one embodiment 
of the invention requires that it be greater than the value 
of 1 .2 times (Max E_D_TOV + MRTT). This requirement 
is taken directly from the Fibre Channel standard in FC- 
PH, which specifies that Min. R A_TOV should maintain 
this relationship, and that a 20% tolerance is required for 
all timers in a Fibre Channel system. 

In one embodiment of the invention, Max. E_D_TOV 
is set to a default value of 10 seconds, and Min. 
E_D_TOV is set to a default value of 2 seconds. Max. 
E_D_TOV must only satisfy the limitation that it be equal 
to or greater than Min. E__D TOV. Min. E_D_TOV should 
be set equal to a value that accounts for MRTT, as well 
as the time necessary for a responding device to reach 
a determination as to how it will respond to a request In 
one embodiment of the invention, Min. E_D_TOV satis- 
fies the relationship of being greater than or equal to 
twice MRTT because this is believed to be a satisfactory 
value for most devices. However, this requirement can 
be altered if it is found not to provide satisfactory system 
performance. 

FC-PH establishes the maximum time for delivery of 
a frame through a Fibre Channel fabric as equaling 1/2 
of MRTT. Based on the prior relationships discussed 
above, Min. E_D_TOV must be greater than or equal to 
2MRTT. and Min. R_A TOV must be greater than 
E_D_TOV + MRTT. Therefore, Min. R_A TOV must be 
greater than 3MRTT. The largest value that Min. 
R_AJ"OV can take using the Fibre Channel clock is 232- 
1. Therefore, MRTT must be less than (232-1) + 3. 

As discussed above, the Max and Min. buffer-to- 
buffer receive data field sizes have some limits placed 
upon them by the Fibre Channel standard. Thus, each 
must be less than or equal to 21 12 bytes, and greater 
than or equal to 128 bytes. Furthermore, Fibre Channel 
requires that information be transmitted in at least 32-bit 
words. Thus, mod 4 of each of the Min. and Max. data 
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field sizes should be equal to 0. Finally, the Max. data 
field size should be greater than or equal to the Min. data 
field size. 

Whenever a DSP process requester and responder 
are not compatible for any of the fabric-wide service 
parameters, a fabric split results between the fabric ele- 
ments, resulting in the formation of at least two distinct 
fabrics in the Fibre Channel system. For example, in the 
illustrative embodiment of the invention having the fabric- 
wide service parameters discussed above, a single 
Reject condition from any of the service parameter com- 
parisons shown in Figs. 3-6 results in a fabric split 
between the requesting and responding fabric elements. 

When a fabric split results between two fabric ele- 
ments, no communication in any of service classes 1 -4 
takes place over the IEL connecting them. For example, 
if a DSP request initiated by fabric element 4 in Fig. 1 

. prompted a Reject condition with any of the service 
parameters of fabric element 2, a fabric split would result 
between these two fabric elements, ensuring that at least 
two distinct fabrics would be formed in the system with 
fabric elements 2 and 4 being in different fabrics. Thus, 
fabric elements 2 and 4 would not communicate in any 
of service classes 1-4 over IEL 20. However, as dis- 
cussed above, the DSP procedure is not run only at ini- 
tialization. Whenever a device or fabric element is added 
or deleted from the system which results in a change of 
service parameters for any fabric element that fabric ele- 
ment issues DSP requests to each of its neighboring fab- 
ric elements. Therefore, despite the fabric split 
communication between fabric elements 2 and 4 contin- 
ues in class F so that subsequent DSP requests can be 
exchanged between the two fabric elements, which 
could lead to a service parameter modification resulting 
in fabric elements 2 and 4 being joined in a single fabric, 

"thereby enabling communication in one or more of serv- 
ice classes 1-4. 

Subfabrics 

It should be recognized from the foregoing discus- 
sion of the illustrative fabric-wide service parameters that 
these parameters are very broad, and can encompass 
devices operating in different service classes, and at dif- 
ferent data rates. Thus, the devices and fabric elements 
contained in a single fabric may be restricted in the serv- 
ice classes and data rates that they can use to commu- 
nicate with one another, or may not be able to 
communicate with one another at all. To determine which 
devices and fabric elements in a fabric can communicate 
and under what conditions, each fabric is sub-divided 
into twenty pre-defined subfabrics. One subfabric corre- 
sponds to each combination of one of the five service 
classes (classes 1-4 and class F) and one of the four 
data rates supported by Fibre Channel. Thus, each sub- 
fabric defines one service class and a single data rate. 
Any device or fabric element that supports the service 
class and data rate defined by a particular subfabric is 
considered to be a part of that subfabric. 



Regions 

Although each fabric element and associated device 
included within a single subfabric will necessarily have 
5 compatible hardware for communicating with other ele- 
ments and devices in the same subfabric, communica- 
tion between each of the devices in a single subfabric is 
not guaranteed. Depending upon the configuration of the 
system, there may not be a path of data links which sup- 
to ports the subfabrics class and data rate through which 
two devices in the subfabric can communicate. Thus, 
each subfabric may be subdivided into a plurality of 
regions, wherein each region defines a group of devices 
and fabric elements within the subfabric that are inter- 
75 connected by at least one path. 

Subfabrics and regions are further explained using 
an illustrative system shown in Figs. 7(a)-(e). Fig. 7(a) 
shows a single fabric 50 having seven fabric elements 
51-57, each connected to at least one of devices 60-74. 
20 The fabric 50 includes data links at two Baud rates, i.e., 
a 1 .0625 GBaud link 80 shown as a solid line intercon- 
necting fabric elements 51-57 and further connecting 
some of the fabric elements to their associated devices, 
and a 265.625 MBaud link 82 shown in dotted line inter- 
ns connecting fabric elements 53 and 55. and connecting 
each of fabric elements 53. 55 and 57 to an associated 
device. The fabric also supports three service classes, 
i.e., service classes 1 -2 and service class F. This com- 
bination of service classes and data rates results in the 
30 fabric 50 supporting four subfabrics that are respectively 
shown in Figs. 7(b)-(e). 

As discussed above, each IEL that establishes a link 
between two fabric elements supports only a single data 
rata Thus, for fabric elements that communicate using 
35 more than one data rate, such as fabric elements 53 and 
55 shown in Fig/7(a). separate lELs are formed for each 
supported data rate. 

Fig. 7(b) shows a first subfabric defined by service 
class 1 and a data rate of 1 .0625 GBaud. This subfabric 
40 includes fabric elements 51 . 52, 54 and 56 and/each of 
their associated devices, as well as fabric element 57 
with one of its associated devices 69. The subfabric of 
Fig. 7(b) is split into two unconnected regions R1 and 
R2. Thus, although fabric elements 51 and 56 and their 
45 associated devices operate at a compatible service class 
and data rate, they cannot communicate because there 
is no path of data links that connects them and supports 
service class 1 and the 1 .0625 GBaud data rate. 

Fig. 7(c) shows a second subfabric defined by serv- 
so ice class 2 and a 1 .0625 GBaud data rate. This subfabric 
includes a single region R3 that includes all of the fabric 
elements and associated devices in the subfabric. 
Among other fabric elements and devices, the subfabric 
of Fig. 7(c) includes fabric elements 52 and 57, as well 
55 as their respectively associated devices 62 and 69, each 
of which was also included in the subfabric of Fig. 7(b). 
These fabric elements and devices are included in more 
than one subfabric because each supports multiple serv- 
ice classes and/or multiple data rates. 
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Fig. 7(d) shows a third subfabric defined by service 
class 2 and a data rate of 265.625 MBaud. This subfabric 
is split into two Regions R4 and R5. The subfabric of Fig. 
7(d) includes both fabric elements 55 and 57. each of 
which is also included in the subfabric of Fig. 7(c). Those 5 
fabric elements are in the same region in the subfabric 
of Fig. 7(c) because a communication path exists 
between them at 1.0625 GBaud. However, no commu- 
nication path exists between fabric elements 55 and 57 
at 265.625 MBaud, causing these fabric elements to be 10 
in separate regions in the subfabric of Fig. 7(d). Thus, 
although these fabric elements are located in two com- 
mon subfabrics, they and their associated devices can 
only communicate in one of the subfabrics. 

Finally Fig. 7(e) shows a subfabric at class F and a is 
data rate of 1 .0625 GBaud. This subfabric includes fabric 
elements 51-57. which each supports this subfabric to 
allow the fabric elements to implement the DSP proce- 
dure discussed above. 

In one embodiment of the invention, service class 20 
and/or data rate translators are provided to enable com- 
munication between two distinct regions. A translator is 
associated with at least one fabric element, and trans- 
lates communications between two different service 
classes and/or data rates so that they are compatible. 25 
thereby enabling communication between devices and 
fabric elements that would otherwise be unable to com- 
municate. 

When a translator is employed between two regions, 
the result is an extended region that includes those two 30 
regions. An example of an extended region is shown in 
Fig. 7(f), in which a data rate translator (not shown) is 
provided in either of fabric elements 55 and 57 to join 
region R3 of Fig. 7(c) and region R4 of Fig. 7(d) to form 
an extended region ER1 . The translation is transparent 35 
to devices 62-64 and 67-69 in extended region ER1 , and 
communication is enabled between any of the devices in 
the same manner that devices within any region of a sub- 
fabric communicate. 

As should be appreciated from the foregoing, the 40 
establishment of fabric-wide service parameters is not 
sufficient to determine which fabric elements and asso- 
ciated devices in the system can communicate with one 
another. The determination of which fabric elements and 
devices can communicate, as well as the service classes 45 
and data rates available for such communication are 
established at the region level. Thus, the present inven- 
tion establishes not only fabric-wide service parameters 
for the system, but also region-wide service parameters. 

The regions/vide service parameters are determined so 
using the same DSP procedure described above in con- 
nection with the fabric-wide service parameters. 
Although fabrics, subfabrics and regions have been 
described in a hierarchical fashion, the establishment of 
the region-wide service parameters is done simultane- ss 
ously with the fabric-wide service parameters, using the 
same series of DSP requests discussed above. 

In one embodiment of the invention, the region-wide 
service parameters each has an associated priority level 



which can be set by the system manager. The priority 
level can be determined by any number of bits. In one 
illustrative embodiment, a two-bit priority level is 
employed as shown in Fig. 8(a). This priority level ena- 
bles each fabric element to identify whether or not it sup- 
ports each of the region-wide service parameters. 
• However, even though a fabric element has the capability 
of supporting a service parameter, the fabric element is 
not necessarily restricted to being grouped only in 
regions wherein the parameter is supported. The priority 
level allows the system manager to identify the following 
three priority levels of support: (1) supported only if all 
other fabric elements support the parameter; (2) sup- 
ported if it requires a region split but not a fabric split; 
and (3) supported even if it requires a fabric split In this 
manner, the system manager has flexibility in determin- 
ing the relative importance of each service parameter to 
the performance of each of his devices. 

When the DSP procedure is executed in the manner 
described above, the priority level for each parameter of 
the Requester and Responder is updated in the manner 
shown in Fig. 8(b). As seen from Fig. 8(b), if either the 
Responder or Requester cannot support a service 
parameter, the priority level is set to indicate that the 
parameter would be unsupported rf the two fabric ele- 
ments were grouped together in a single region or fabric. 
Otherwise, the priority level is updated to match the 
higher priority of the Requester and Responder. 

The region-wide service parameters are established 
to be consistent for each device and fabric element in a 
region. In order identify the devices within each region, 
one of the region-wide service parameters is a region ID. 
The region ID is similar in many respects to the fabric 
name that was discussed above in connection with the 
fabric-wide service parameters. The region ID is estab- 
lished, much like the fabric name, by the DSP procedure 
through the sending of DSP requests from each fabric 
element in the system. However, while the fabric name 
is the same for every port of a fabric element, the region 
names assigned to the E_Ports of any fabric element 
may differ. 

As discussed above, each E_Portof a fabric element 
supports only a single data rate. Different E_Ports for a 
single fabric element may support different data rates, 
resulting in those E_Ports being grouped in different 
regions, even if they support a common service class. 
Furthermore, two E_Ports of a single fabric element may 
support different service classes, resulting in their being 
assigned to different subfabrics, and thus, to different 
regions. If two ports in a single fabric element support 
the same service class and data rate, those ports should 
be cdmbined in the same region for that service class. 
Since the fabric element stores information regarding the 
service classes and data rates supported by each of its 
ports, the fabric element ensures that during the DSP 
procedure, ports within a single fabric element that sup- 
port a common service class and data rate are grouped 
in the same region for that service class. This can be 
accomplished by maintaining a list in each fabric element 



10 



:NSDOCID:<EP 0713307A2 I > 



BNS Daoe 10 



19 



EP 0 713 307 A2 



20 



of its ports that belong to a common region, or by other 
means. 

Because two ports of a single fabric element can 
belong to different regions, the region ID, as well as each 
of the other region-wide service parameters, can poten- s 
tially differ for each E_Port of a fabric element. Further- 
more, since a single port of a fabric element can support 
each of service classes 1-4 and F, each port can poten- 
tially be included within five different subfabric regions, 
each having its own set of region-wide service parame- w 
ters. Thus, although each fabric element has only a sin- 
gle set of fabric-wide service parameters common to all 
of its ports, the DSP procedure may need to determine 
as many as four sets of region-wide service parameters 
(one for each of service classes 1 -4) for each E_Port; no is 
set of region-wide parameters need be determined by 
the DSP procedure for class F because every fabric ele- 
ment supports a fixed set of service parameters for com- 
municating in this service class. 

In one illustrative embodiment of the invention, the 20 
fabric-wide and region-wide service parameters are 
transferred between fabric elements during the DSP pro- 
cedure, and stored within each fabric element, in a data 
frame format shown in Figs. 10(a)-(c). Fig. 10(a) shows 
a groiqa of bits for establishing the fabric-wide service 25 
parameters for all ports in the fabric element, while Fig. 
10(b) shows a group of bits for establishing region-wide 
service parameters for a single service class of one 
E_Port. The bit format shown in Fig. 10(b) is replicated 
once for each of service classes 1 -4 for every E_Port 30 
Following a command code that identifies a DSP request 
from any E_Port in the fabric element, the first 44 bytes 
of the request data frame specify the fabric-wide service 
parameters for the fabric element as shown in Fig. 1 0(a). 
and are followed by four 20-byte sets of region-wide serv- 35 
ice parameters for the requesting E_Port, in the format 
shown in Fig. 10(b). Although each fabric element port 
can theoretically be included in any of the twenty possi- 
ble subfabrics discussed above, the fact that each 
E_Port and its associated I EL supports only a single data 40 
rate limits the number of subfabrics to which each port 
can belong to the five subfabrics that include the sup- 
ported data rate. Furthermore, since the service param- 
eters for class F are predetermined for every fabric 
element port, these parameters are not stored and trans- 45 
f erred as part of the DSP procedure. Thus, the use of 
four fields of region-wide service parameters, one for 
each of service classes 1-4, in combination with the 
Known data rate for the requesting and responding 
E_Ports is sufficient to distinctly define the four possible so 
regions to which each E_Port can belong. 

The above-described data frame organization for 
storing and transferring the fabric-wide and region-wide 
service parameters during the DSP procedure is pro- 
vided merely for illustrative purposes. A number of other ss 
formats can alternately be employed. Furthermore, other 
techniques can also be employed for designating the fab- 
ric-wide service parameters common to every E_Port, 



and the particular region-wide service parameters that 
can vary for each. 

As discussed above, one of the region-wide service 
parameters is a region ID which is used to uniquely iden- 
tify each region. The region ID is a concatenation of three 
fields shown in Fig. 10(b), i.e., the 64-bit region name 
field, the 8-bit subfabric ID (SFJD) field and the 8-bit 
region name priority field. The region name is deter- 
mined by the DSP procedure in much the same manner 
as the above-described technique for determining the 
fabric name. In particular, each fabric element port is 
assigned a unique ID name, which can be one of the 
IEEE values discussed above. When the DSP process 
begins, each fabric element determines a single region 
name for each of its ports that belong to the same region. 
This can be done, for example, by selecting the lowest 
ID name for the ports in the region. The region name for 
each E_Port is then compared, in each of service 
classes 1 -4, with the region name of the E_Port to which 
it is connected across an IEL These four comparisons 
are only relevant for those service classes which are sup- 
ported by both E_Ports, i.e., the DSP Requester and 
Responder. If the service class is not supported by both, 
the DSP request does not result in the updating of the 
region name for either. However, when both the 
Requester and Responder support a particular service 
class, the comparison results in their adopting a common 
region name, for example, by adopting the lowest region 
name ID in the manner described above in connection 
with the fabric name. The DSP procedure continues until 
a stable condition is reached in the manner described 
above. It should be recognized that since a single E_Port 
can support multiple service classes, the port may 
belong to a different region for each service class. Thus, 
the region name for any particular E_Port may be differ- 
ent in the four data frame fields of Fig. 10(b) thatcorre*- 
spond to the different service classes. 

At the conclusion of the DSP procedure, each region 
is identified by a unique region name having been com- 
monly adopted by the fabric element ports belonging to 
the region. For a system without service class or data 
rate translators, the region name can simply be adopted 
as the region ID, because along with its corresponding 
position in the DSP data frame which establishes the 
service class to which it relates, as well as the known 
data rate which the corresponding E_Port supports, the 
region name uniquely identifies the region. 

For systems with service class or data rate transla- 
tors that can result in the formation of extended regions, 
the region name is insufficient to uniquely identify each 
region, because the corresponcfing service class and 
data rate do not necessarily bound an extended region, 
which can extend across multiple service classes and/or 
data rates. Thus, one embodiment of the invention pro- 
vides a technique for determining whether ports having 
the same region name in different service classes are 
actually in distinct regions, or part of a single extended 
region. 
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The use of the subfabric ID field shown in Fig. 1 0 is to compare the fabric and region IDs during the DSP pro- 
one technique for providing a common region ID within cedure. 

the DSP data fields corresponding to service classes 1 - | n one illustrative embodiment of the invention, the 

4 for ports that are part of an extended region. In one other region-wide service parameters include buffer-to- 

illustrative embodiment, the subfabric ID (SFJD) is an 5 buffer data field sizes for each region, an addressing 

8-bit field having the bit assignments shown in Fig. 1 0(c). mode, a region-wide routing method, and various class- 

For each of the ports of a fabric element that is not cou- specific parameters. 

pled to a class translator, the subfabric ID identifies the The buffer-to-buffer data field size can be identified 

data rate supported by the port, and has bit values that with Min. and Max. values separately for each subclass 

identify the corresponding service class for each of the 10 supported by a fabric element. Other than its association 

four DSP data frame positions corresponding to service with only a single subclass, these Min. and Max. data 

classes 1 -4. However, for a port whose associated fabric fields operate in the same manner as the data field sizes 

element is connected to a class translator, the subfabric discussed above in connection with the fabric-wide serv- 

ID is not necessarily established in this straightforward ice parameters. 

manner because at least two of the port's service classes 75 Addressing mode defines one of the following four 

will be within the same region. Therefore, their subfabric modes supported by Fibre Channel: (1) administrative; 

IDs are established to be equal to one another. This can (2) automatic; (3) directed; and (4) unconstrained. These 

be done by adopting tfie lowest ID value for the region .modes define the manner in which the address for each 

ID field of the involved service classes, which as dis- device port and fabric element port is determined, 

cussed above, is a concatenation of the region name pri- 20 Addresses are used to define the destination for a trans- 

ority, the subfabric ID and the region name. As the DSP mitted data frame. Although each device includes a 

procedure proceeds, whenever one of the region IDs for unique ID name, that name is not used for addressing 

a service class that is coupled to another via a service purposes. For example, the above-described unique 

class translator is updated, the region ID for the other names assigned according to the IEEE service are 64- 

class is also updated. As a result, the DSP procedure 25 bit names, whereas most networks provide a smaller 

results in a common region ID being adopted for each address field, e.g.. 24 bits. 

fabric element port that belongs to an extended region. | n administrative mode, a system administrator man- 
Any fabric element that includes a data rate transla- ually assigns an address for each port In automatic 
tor recognizes that two of its ports which support different mode, the system automatically determines the address 
data rates are part of the same extended region, and 30 for each port using a pre-defined protocol. In directed 
assigns them a common region name in the same man- mode, the address for each port is initially assigned auto- 
ner in which any two ports of the fabric element that are matically, but a system administrator can modify the 
part of the same region are assigned a common region results. The unconstrained mode is currently not imple- 
name. Thus, the subfabric ID is not necessary to merited and is reserved for future use. 
uniquely identify ports that belong to an extended region 35 Fibre Channel also supports various routing meth- 
formed solely by a data rate translator. The region name ods which define how data link paths are determined 
is sufficient bemuse two ports that support different data through the fabric when a data frame is transmitted 
rates can only be assigned the same region name when between two devices in the system. The following three 
they belong to the same extended region. The data rate routing methods are supported: 
component of the SFJD is not necessary to uniquely 40 (1) self-routing; (2) supervised; and (3) unrestricted. In 
identify extended regions, but is provided because it may self-routing mode, the switches in the system automati- 
prove useful for other purposes. cally figure out a path for routing a frame between two 
As discussed above, for systems in which extended devices. In supervised mode, the switches initially deter- 
regions are supported, the region name is a concatena- mine a routing path, but the path can be modified by a 
tion of the region name priority, subfabric ID and region 45 system administrator if desired. In unrestricted mode, a 
name. In one embodiment of the invention, each fabric system administrator manually provides the system with 
is identified with a fabric ID that is formed in a similar the desired routing path. 

manner, i.e., the fabric ID is a concatenation of the fabric As mentioned above, the region-wide service 
name priority, subfabric ID and fabric name. In the parameters include a number of class specific parame- 
embodiments previously described, the fabric name so ters that may vary for each class supported by a fabric 
alone was used to uniquely identify each fabric, because element A first of these parameters is a class validity 
even when extended regions are supported, the fabric field which indicates, for the specific class at issue, 
name is sufficient to uniquely identify each fabric. How- whether the associated port of the fabric element sup- 
ever, for the sake of simplifying the hardware and soft- ports the class. 

ware used to compare IDs of the Requester and ss Two additional parameters relate to a sequential 

Responder during the DSP procedure, one embodiment delivery feature which ensures that when a device 

of the invention uses the fabric ID to uniquely identify sources two consecutive frames through the fabric, they 

each fabric'when extended regions are supported. In this will arrive in the same order at the destination. Two types 

manner, the same hardware and software can be used of sequential delivery may be supported, i.e., global and 
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selective. With global sequential delivery, sequential 
delivery is ensured by the fabric every time frames are 
transferred through the fabric. With selective sequential 
delivery, in-order delivery is only ensured when 
requested by a device. The illustrative region-wide serv- 5 
ice parameters include two bits that respectively indicate 
whether the global and selective sequential delivery fea- 
tures are supported by the port of the fabric element 
transmitting the DSP frame. 

Two additional service parameters relate to a 10 
stacked connection feature, which is useful in imple- 
menting service class 1 . In class 1 , a dedicated connec- 
tion path is maintained by the fabric between two 
devices, which are the orrfy users of that path. The 
stacked connect feature allows a source to transmit mul- is 
tiple requests for such a connection, wait to see which 
device is first to respond, and then form a dedicated con- 
nection with that device. Two modes of stacked connec- 

tion are supported, i.e., transparent and lock-down. The 
transparent stacked connect feature allows a device 20 
receiving a connection request to immediately respond 
and begin using the connection. The receiving device 
need not await any indication that the connection has 
been made, because it is made automatically. In this 
mode, the fabric ensures that no two devices can simul- 25 
taneously receive requests for a connection from a single 
source. In lock-down mode, the fabric does not prevent 
connections from being made simultaneously with two 
devices. Therefore, a device that receives a request for 
a dedicated connection does not begin using the con- 30 
nection immediately. Rather, the device sends an indica- 
tion to the requester that it is available for the requested 
connection, but must await notification that the connec- 
tion has been made before it can begin using the con- 
nection. 35 

The region-wide service parameters discussed 
above are useful in implementing service classes 1-4. 
The table shown in Fig. 9 demonstrates the applicability 
of these region-wide service parameters to each of serv- 
ice classes 1 -4. An "n" (no) in Fig. 9 indicates that a par- 40 
ticular service parameter is not applicable to the relevant 
service class, and a y (yes) indicates that the parame- 
ter is applicable to the dass. The left-hand column of Fig. 
9 indicates a bit number for each of the service param- 
eters and relates to an illustrative arrangement of a data 45 
frame to be transmitted between requesting and 
responding fabric elements during the DSP procedure 
as described in more detail below. 

It should be understood that the specific region-wide 
service parameters discussed above are provided so 
merely for illustrative purposes, and that alternate 
parameters can also be provided. Region -wide service 
parameters are those which define service options that 
should be supported by every fabric element and device 
in a region, so that every device in a region can commu- ss 
nicate using consistent parameters. During the DSP pro- 
cedure, the question of whether a particular service 
option will be adopted for a region depends not only on 
whether it is supported by the fabric elements that could 



24 

potentially be within the region, but also on the priority 
levels established by each of the fabric elements as dis- 
cussed above in connection with Fig. 8. 

Figs. 10(a) and (b) show an illustrative data frame 
format that can be used to perform the DSP procedure 
discussed above in connection with establishing fabric- 
wide and region-wide service parameters. Fig. 10 (a) 
shows a group of bits for establishing the fabric-wide 
service parameters. Fig. 10(b) shows a set of bits for 
establishing the region-wide service-parameters for a 
single service class. As discussed above, the bit format 
shown in Fig. 1 0(b) is replicated once for each of service 
classes 1-4. Following a command code that identifies a 
DSP request the first 44 bytes of the frame specify the 
fabric-wide service parameters as shown in Fig. 10(a), 
and are followed by four 20 byte sets of region-wide serv- 
ice parameters in the format shown in Fig. 10(b). In this 
illustrative embodiment, the region-wide service options 
shown in bits (31 -16) of words zero and one in Fig. 10(b) 
have the bit assignments shown in Fig. 9. The priority 
level for each service parameter is established by the 
value of the corresponding bits in words zero (E) and one 
(e), in the manner shown in Fig. 8. It should be under- 
stood that this particular data format is provided merely 
for illustrative purposes, and that alternate formats can 
also be used. 

Fig. 11 is a flowchart of one methodfor implementing 
the DSP procedure within each fabric element This flow- 
chart is provided merely for illustrative purposes, and it 
should be understood that the DSP procedure can be 
implemented in a number of other ways. As discussed 
above, the DSP procedure does not require synchroni- 
zation between the fabric elements. Thus, when the 
method begins at initialization, it can respond to DSP 
request from another fabric element as shown in step 
1 01 , or can initiate its own DSP request as shown in step 
100, depending on the relative timing of the initialization 
of the fabric elements. When a DSP request Is received 
prior to the host fabric element initiating its own DSP 
request, the method proceeds to step 102 wherein the 
service parameters of the host fabric dement are com- 
pared with those of the DSP requester. In step 103, a 
determination is made as to whether the service param- 
eters of the host fabric element should be updated as a 
result of the DSP request. When no updating is required, 
the method proceeds to step 105 wherein an IE_ACC 
data frame is sent specifying the service parameters of 
the host fabric element When it is determined at step 

103 that the service parameters of the host fabric ele- 
ment should be updated, the method proceeds to step 

104 wherein the updating occurs. The method then pro- 
ceeds to step 105 wherein an IE_ACC data frame is sent 
to the requesting fabric element specifying the updated 
service parameters of the host. The method then returns 
to the initial stage, wherein it can respond to another DSP 
request, or can initiate its own DSP request in step 1 00. 

After initialization, the host fabric element initiates 
its own DSP request at step 1 00. The host then waits, at 
step 106, to receive an IE_ACC data frame from the 
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responding fabric element, and when it is received, pro- 
ceeds to step 107 wherein the service parameters of the 
responding fabric element are compared with those of 
the host. In step 108, a determination is made as to 
whether the service parameters of the host will be 5 
updated in response to the IE_ACC data frame, and 
when they will, the method proceeds to step 1 09 wherein 
the updating occurs. After the service parameters are 
updated at step 109, the method returns to step 100 
wherein a new DSP request is issued with the updated w 
service parameters. When it is determined at step 108 
that no updating was required, the method proceeds to 
step 1 1 0 wherein a timer is set to establish a time period 
during which it is expected that another DSP request will 
be received if the DSP procedure has not reached a sta- 15 
ble state. At step 1 1 1, a check is made to see whether 
another DSP request gas been received, and when one 
has not been received, the method proceeds to step 1 12 
to determine whether the timer has expired. If the timer 
has not expired, the method returns to step 1 1 1 . In this 20 
manner, the method continually checks for a new DSP 
request, and if none is received before the timer expires, 
the method proceeds to step 1 13. At step 1 13, a deter- 
mination is made as to whether the host service param- 
eters were updated by the method, and if they were not 25 
the method terminates. When it is determined at step 

1 1 3 that the service parameters of the host were updated 
during that DSP procedure, the method proceeds to step 

114 wherein the host fabric element and its associated 
devices are taken off-line and reinitialized with the new 30 
service parameters. 

When it is determined at step 111 that a new DSP 
request has been received before the expiration of the 
timer, the method proceeds to step 1 1 5 wherein the serv- 
ice parameters of the host are compared with those of 35 
the DSP requester. The method then proceeds to step 
1 1 6 wherein a determination is made as to whether the 
service parameters of the host are to be updated as a 
result of the DSP request When it is determined at step 
116 that the service parameters should be updated, the 40 
method proceeds to step 117 wherein the updating 
occurs, and then to step 118 wherein the IE_ACC data 
frame is sent with the updated service parameters. After 
sending the IE_ACC data frame at step 1 1 8, the method 
returns to step 1 00 wherein a new DSP request is issued 45 
with the updated service parameters. When it is deter- 
mined at step 116 that the service parameters need not 
be updated, the method proceeds to step 119 wherein 
an IE_ACC data frame is sent with the hosfs service 
parameters. After sending the IE_ACC data frame at so 
step 119. the method returns to step 110 wherein the 
timer is set and the host waits for another DSP request, 
or detection of the stable condition. 

As discussed above, one embodiment of the inven- 
tion determines a unique name for each fabric and region ss 
by adopting the name of a single fabric element for each. 
If the fabric element that provides the name to a fabric 
or region becomes inactive or is removed from the sys- 
tem, it is desirable to rename the associated fabric or 



region. Therefore, in one embodiment of the invention, a 
technique is provided to detect when a fabric element 
that provides the name for a fabric or region becomes 
inactive or is removed from its corresponding fabric or 
region. 

Each fabric element that provides the name for a fab- 
ric or region periodically transmits a validate name (VN) 
data frame to its adjacent fabric elements. In one embod- 
iment of the invention. VN data frames are transmitted 
by each name providing fabric element every .5 x Min. 
R_A_TOV. The VN data frame includes the name of the 
name provider, a time field indicating a time at which the 
frame was sent, and a distance field. The time and dis- 
tance fields can be considered to be fabric and region 
service parameters, but an updating of these parameters 
does not trigger transmission of a DSP request. The time 
field is set to zero for the first VN data frame sent by a 
name provider, and is incremented for each subsequent 
VN data frame. The distance field is set to zero by the 
name provider, and is updated by other fabric elements 
in a manner described below. The time field is not 
updated by other fabric elements. 

Whenever a VN data frame is received by a fabric 
element, it returns an error signal if the fabric or region 
name is invalid. If the VN data frame is valid, the receiving 
fabric element compares the information contained 
therein against two of its service parameters, and 
depending upon the result of those comparisons, takes 
any of various actions as shown in Fig. 15. Each fabric 
element stores a "Service parameter Time" (Fig. 15) 
which relates to the time at which a previously received 
VN data frame was sent by the name provider, and a 
"Service parameter Distance" (Fig. 15) which relates to 
the lowest number of fabric elements through a previ- 
ously received VN data frame passed before reaching 
the fabric element Whenever a VN data frame is 
received, the Service parameter Time for the recipient is 
compared with the time at which the newly received VN 
frame was sent by the name provider (designated as "VN 
frame Time" in Fig. 1 5). If the Service parameter Tjme is 
greater than the VN frame Time for the newly received 
VN data frame, it indicates that the newly received VN 
frame is stale. Thus, no action is taken in response to its 
receipt. 

When a VN data frame is received by a fabric ele- 
ment, another comparison made is the Service param- 
eter Distance versus the VN frame Distance plus one. 
The VN frame Distance designates the distance that the 
VN frame travelled from the name provider to reach the 
fabric element adjacent the one receiving the VN frame. 
When it is determined that the VN frame Time equals the 
Service parameter Time, and further that the VN frame 
Distance plus one is greater than or equal to the Service 
parameter Distance, it indicates that that VN data frame 
was transmitted at the same time as one already 
received by the fabric element, and traversed a path that 
was at least as long as the path traversed by the previ- 
ously received VN data frame. Thus, the newly received 
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VN data frame is stale, and no action is taken by the 
receiving fabric element. 

When it is determined that the VN frame Time 
equals the Service parameter Time, and further that the 
VN frame Distance plus one is less than the Service 5 
parameter Distance, it indicates that the newly received 
VN data frame was transmitted at the same time as a 
previously received frame, but has traversed a shorter 
path. When such a data frame is received, the receiving 
fabric element updates its VN service parameters (i.e., 10 
Service parameter Time and VN frame Distance) in the 
manner shown in Fig. 15. As a result the VN service 
parameters identify the shortest path between the name 
provider and the receiving fabric element, which is useful 
for reasons described below. Furthermore, the receiving is 
fabric element also transmits a VN data frame over each 
of its associated lELs. The VN frame Time for the trans- 
mitted VN frames is the same as that of the received data 

frame, and the VN frame Distance is incremented by one. 

Finally, when the VN frame Time is greater than the 20 
Service parameter Time, it indicates that the received 
data frame is a new VN data frame that was transmitted 
subsequent to the previously received one. In response, 
the fabric element again updates its VN service param- 
eters and re-transmits VN data frames over its associ- 25 
ated lELs, with the VN frame Time being equal to that of 
the newly received VN frame, and the VN frame Distance 
being incremented by one. 

Each fabric element considers the name provider to 
have become inactive if a new VN data frame is not 30 
received from the name provider within a specified time 
period following receipt of a previous VN data frame. In 
one embodiment of the invention, this time period equals 
the fabric element's Service parameter Distance times 
R_A_TOV. When the Service parameter Distance is 35 
used to establish this time period, it is desirable for this 
parameter to reflect the shortest path between the host 
fabric element and the name provider. Thus, whenever 
a VN frame is received that was transmitted by the name 
provider at the same time as a previously received VN 40 
frame but has travelled a shorter path, the Service 
parameter Distance is updated to reflect the shorter path 
as discussed above. 

After the time period has expired without a new VN 
frame having been received, the fabric element responds 45 
as busy to any DSP request relating to the fabric or region 
that has adopted the name of the suspected inactive fab- 
ric element The fabric element responds as busy to 
ensure that a race condition does not develop if some 
fabric elements are waiting for a DSP request to become so 
stable for a fabric or region, while others are waiting for 
the VN time period to expire for the same fabric or region. 
After establishing itself as busy, the fabric element waits 
an additional time period of 2 x Service parameter Dis- 
tance x R_A_TOV to confirm the inactive status of the ss 
name provider. When the inactive status has been con- 
firmed, the fabric element changes all of its fabric-wide 
or region-wide service parameters associated with the 
inactive name provider to their power-up default values. 



This results in the initiation of a new DSP procedure, in 
which a new fabric element is chosen as the name pro- 
vider for the fabric or region. 

Address Partitioning 

As discussed above. Fibre Channel supports four 
different addressing modes for determining a unique 
address for each port in the system. In two of these 
modes, the addresses are automatically assigned. In 
one embodiment of the invention, the fabric elements in 
the system assign unique addresses to each port using 
a procedure that is similar in some respects to the DSP 
procedure discussed above. 

ft has previously been proposed to partition the Fibre 
Channel node addresses using a three level hierarchy, 
including a domain identifier (domainJD) at the highest 
level, an area identifier (areaJD) at the intermediate 
level, and a port identifier (portJD) at the lowest level. 
For example, for a system that employs a 24-bit node 
address, the most significant byte can be assigned to the 
domainJD, the middle byte to the areaJD, and the least 
significant byte to the portJD. This hierarchical address 
partitioning is analogous to the numbering scheme used 
for telephones in North America, which employs a 10- 
digrt number having three hierarchical levels. The tele- 
phone area code is analogous to the domainJD in Fibre 
Channel, the middle three digits are analogous to the 
area J D, and the last four digits are analogous to the 
portJD. 

Fig. 12 provides an illustrative assignment of 
addresses using a 24-bit address field wherein the most 
significant eight bits specify the domainJD, the middle 
eight bits specify the area J D, and the low order eight 
bits specify the portJD. If the entire 8-bit domainJD field 
was used for port addresses, it would support 28 or 256 
distinct domains. However, in the illustrative embodiment 
of the invention shown in Fig. 12, the following 
domainJD bit assignments are reserved or assigned to 
special functions: "OOOOOOOO"; "1 1 1 1Qxxx"; "1 1 >1 10xx"; 
"1111110x"; •111t1110"; and "11111111". Eabhof the 
other domainJD bit assignments are used for port iden- 
tifiers. 

All area J D and portJD bit assignments within the 
above-referenced domains are also reserved or 
assigned to special functions. Additionally, within each 
of the domains available for assignment to port 
addresses, a group of addresses is reserved to assist in 
the implementation of certain fabric assisted functions. 
The reserved addresses are designated in Fig. 1 2 by the 
following notation: 

(DomainJD) 1111 (Special JD). As this notation indi- 
cates, within each domain available for assignment to 
port addresses, all the bit assignments within areaJDs 
1111XXXX are reserved, providing 978,944 address 
assignments to assist in implementing fabric assisted 
functions. This particular partitioning is provided merely 
for illustrative purposes, and it should be understood that 
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the number of address assignments reserved or 
assigned to special functions can vary. 

Other than the special cases discussed above, the 
other bit assignments are used to identify the ports in the 
Fibre Channel system with unique 24-bit addresses. The s 
area ID field includes eight bits, providing 256 unique bit 
assignments. However, since sixteen bit assignments 
within each domain are used for fabric assisted functions 
as discussed above, only 240 unique areas are available 
within each domain. Because the portJD include eight 10 
bits, each area includes 256 distinct port addresses. 

In one embodiment of the invention, addresses are 
assigned to each port in the system by a series of 
address managers. The address managers include: one 
master domain address manager (MDAM) for each fab- is 
ric; one master area address manager (MAAM) and one 
domain address manager (DAM) for each domain; one 
master port address manager (MPAM) and one area 
address manager (AAM) for each area; and one port 
address manager (RAM) for each port address. Follow- 20 
ing initialization, the address managers function to col- 
lectively assign a unique address to every port in the 
system. Each of the address managers is implemented 
in a single fabric element Thus, a fabric element that 
supports either automatic or directed address assign- 25 
ment should support the functions of each of the above- 
described address managers. 

One function of the MDAM is to assign a new 
domainJD bit assignment to each newly created 
domain. The MDAM maintains a list of which domainj D 30 
bit assignments it has previously assigned. The MDAM 
also detects the absence of a once active domain, and 
makes the corresponding domain_ID available for reas- 
signment. New domains are created in response to 
requests received from fabric elements as described 35 
below. The MDAM also functions as the DAM for the 
domain of the port addresses for the fabric element in 
which the MDAM is implemented. 

Each domain has an associated DAM and MAAM, 
which are implemented in the same fabric element One 40 
function of the DAM is to communicate with the MDAM 
to ensure that it remains active. This function is 
described more fully below. If the MDAM becomes inac- 
tive, a new one is selected. The MAAM is responsible for 
assigning a new areaJD bit assignment for every newly 45 
created area within its associated domain, much like the 
MDAM is responsible for assigning new domains. New 
areas are created in response to requests received from 
fabric elements. The MAAM also detects the absence of 
a previously active area, and makes the corresponding so 
areaJD available for reassignment. The MAAM func- 
tions as the AAM for the area of the port addresses for 
the fabric element in which the MAAM is implemented. 

Each area has an associated AAM and MPAM, 
which are implemented in the same fabric element. Each ss 
AAM detects the absence of the MAAM for its area, and 
when it becomes non-functional, a new MAAM is 
selected. The MPAM is responsible for assigning a new 
port_ID bit assignment for every newly created port 



address within its associated area, much like the MDAM 
and MAAM respectively assign new domains and areas. 
New portJDs are assigned in response to requests 
received from fabric elements. The MPAM also detects 
the absence of ports and makes their identifiers available 
for reassignment. The MDAM also functions as the PAM 
for the portJDs assigned to the ports in the fabric ele- 
ment in which the MPAM is implemented. 

One PAM is active for each assigned port_ID. The 
PAM assigns the portJD to its associated port. Each 
PAM also detects the absence of the MPAM and when it 
becomes non-functional, a new MPAM is designated. 

The address managers collectively assign 
addresses to the ports in the system in the following man- 
ner. When the system is initialized, one fabric element 
for each fabric is designated as the master. The master 
fabric element includes the MDAM for the fabric. The 
MDAM initially has control, over the assignment of each 
of the available 24-bit port addresses for the fabric. In 
one embodiment of the invention, the master fabric ele- 
ment for each fabric is selected to be the one whose ID 
name was adopted as the fabric name during the DSP 
procedure. However, it should be understood that a mas- 
ter fabric element can be determined for each fabric in 
other ways. 

Initially, the master fabric element assigns 24-bit 
addresses to each of its ports. The assigned addresses 
necessarily include at least one domainj D bit assign- 
ment at least one areaJD bit assignment and at least 
one portJD bit assignment. Thus, the master fabric ele- 
ment implements a number of address managers. In its 
capacity as the M DAM, the master fabric element selects 
a domainJD to establish a domain to which its port 
addresses will belong. In doing so, the master becomes 
the DAM and MAAM for that domain. In its capacity as 
the MAAM for the domain, the master fabric element also 
selects an areaJD to establish an area to which its port 
addresses will belong. In doing so, the master becomes 
the AAM and MPAM for that area. In its capacity as the 
MPAM for the area, trie master fabric element selects 
port JDs for each of its ports, and becomes the RAM for 
each port by assigning an address to each port. 

For example, if the master fabric element assigns 
addresses having hexadecimal values "010000" and 
"010001" to two of its ports, the master is designated as 
the MDAM for the fabric, the DAM and MAAM for 
domainJD "01", the AAM and MPAM for areaJD "00" 
within domain "01 ". and the PAM for portJDs "00" and 
"01 "within domain "01" and area "00". 

After the master fabric element assigns addresses 
to its own ports, addresses are next assigned to the ports 
of its adjacent fabric elements, then to the fabric ele- 
ments adjacent to those, and so on. Addresses are not 
assigned to the ports of a fabric element until the fabric 
element issues a request for addresses. When the sys- 
tem is initialized, every port in the system is assigned a 
common address. Through an established address com- 
munication protocol, the fabric elements communicate 
with each other over the lELs connecting their E_Ports. 
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When a fabric element detects that the address of the 
E^Port of its adjacent fabric element is equaJ to the ini- 
tialized address, the fabric element recognizes that valid 
addresses have not yet been assigned to the ports of 
that fabric element. Thus, the fabric element recognizes 5 
that there are no address managers in its adjacent fabric 
element to handle a request for the assignment of 
addresses, and therefore, no request is made. A fabric 
element does not make a request for an assignment of 
addresses for its ports until it detects a valid address on 10 
an E_Port of one of its adjacent fabric elements, indicat- 
ing that the adjacent fabric element has at least one 
address manager for handling such a request. 

After the master fabric element has assigned 
addresses to each of its ports, the fabric elements adja- is 
cent the master will detect valid addresses on its 
E_Ports. Each of the adjacent fabric elements then 
requests a certain number of addresses. The number of 
addresses requested will be equal to at least the number 
of ports in the requesting fabric element and may include 20 
a number of additional addresses. 

A number of options are available to a fabric element 
in requesting addresses for assignment to its ports. The 
fabric element can request that it be provided with 
addresses within a domain and area that have already 25 
been created, in which case only new portJD bit assign- 
ments need be determined. For example, the fabric ele- 
ments adjacent the master can request addresses within 
the same domain and area as the addresses already 
assigned by the master to its own ports. When such a 30 
request is received by the master fabric element, it acts 
in its capacity as the MPAM for the area, and selects the 
requested number of previously unassigned portJDs 
and transfers them to the requester. The requesting fab- 
ric element then implements a RAM for each of its ports 35 
and assigns one address to each of the ports. 

Another option for a fabric element is to request 
addresses that are in a domain that has already been 
established, but that establish a new area. For example, 
the fabric elements adjacent the master can request 40 
addresses within the same domain as the addresses 
already assigned by the master to Hs own ports, but 
within a new area. When such a request is received by 
the master fabric element, it acts in its capacity as the 
MAAM for the domain by selecting a previously unas- 45 
signed areaJD and transfering it to the requester. The 
requesting fabric element becomes the AAM and MPAM 
for the newly created area. As the MPAM, the fabric ele- 
ment controls the selection of the port_IDs within the 
newly created area. Initially, the fabric element imple- so 
ments a RAM for each of its ports, and assigns each port 
a unique address within the area. Any unused portJDs 
within the area are available for assignment to other fab- 
ric elements, under the control of the fabric element in 
its capacity as the MPAM for the area. After the fabric ss 
element adjacent the master has assigned addresses to 
its ports, its adjacent fabric elements will detect valid 
addresses on its ports, and may request an assignment 
of addresses within the same area. In its capacity as the 
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MPAM for the area, the fabric element can respond to 
such requests by selecting the requested number of pre- 
viously unassigned port_IDs in the area and transferring 
them to the requester, which then implements a RAM for 
each port by assigning one of the addresses to each. 

Another option for a fabric element is to request 
addresses that are in a new domain, i.e., a previously 
unassigned domain. All such requests are ultimately 
handled by the MDAM in the master fabric element. 
When it receives such a request, the MDAM selects a 
previously unassigned domainJD and transfers it to the 
requester. The fabric element that receives the new 
domainJD then selects an area within the domain, and 
a group of port addresses within the area for assignment 
to its fabric element ports. In doing so, the fabric element 
becomes the DAM and MAAM for the domain, the AAM 
and MPAM for the area, and the RAM for each of Hs ports. 

.. As should be appreciated from the foregoing, the „. 
present invention provides a hierarchy of address man- 
agers for assigning addresses to ports within a Fibre 
Channel system. This hierarchy is shown conceptually 
in Fig. 13. Each fabric includes a single MDAM 120 that 
determines which domain_JDs have been assigned and 
selects an unused domainJD when a new domain is cre- 
ated. Each domain includes a corresponding DAM 122 
and MAAM 1 24. The MAAM determines which area JDs 
have been assigned in the domain and selects an 
unused areaJD when a new area is created within the 
corresponding domain. Each area within a domain 
includes a corresponding AAM 1 26 and MPAM 1 28. The 
MPAM determines which portJDs have been assigned 
and selects an unused port JD when a new port is cre- 
ated within the corresponding area. Each port also 
includes a corresponding PAM 130 which controls the 
assignment of a port J D to that port As shown in Fig. 
13, the MDAM 120 also acts as a DAM for at least one 
domain, the MAAM 124 acts as an AAM for at least one 
area, and the MPAM 128 acts as a PAM for at least one 
port. 

As seen from the foregoing, the present invention 
provides a technique for automatically partitioning and 
assigning unique addresses to the ports of a Fibre Chan- 
nel system. This technique employs address managers 
that control the selection and assignment of the port 
addresses. At initialization, the selection and assignment 
of every port address is controlled by a single fabric ele- 
ment (i.e. the MDAM). Through communication with 
other fabric elements in the system having ports to which 
an address is to be assigned, the MDAM transfers control 
of certain address ranges to other fabric elements, which 
become address managers for those address ranges. In 
this manner, the assignment and control of every port 
address is always under the control of a single fabric ele- 
ment so that the addresses can be automatically 
assigned to every port in the system. 

The manner in which data frames are routed in Fibre 
Channel places some limitations on the manner in which 
port addresses can be assigned. When the above- 
described hierarchical addressing scheme is employed. 
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routing of data frames between two port addresses is 
also done in a hierarchical fashion. When a data frame 
is transmitted from a first port and to a second port that 
is in a different domain, the frame is routed in three 
stages. The first routing stage is to route the data frame 
through the fabric from the domain of the first port to the 
domain of the second. In doing so, the data frame may 
be routed to at any port having an address within the sec- 
ond domain. Once the data frame arrives within the des- 
tination domain, the second stage is to route the frame 
from the area in which it arrives to the area of the desti- 
nation, while remaining within the destination domain. 
The data frame is routed to the destination area using 
only ports that all have the same domain_ID as the des- 
tination port. Routing between areas similarly results in 
the data frame arriving, without restriction, at any port 
within the destination area. Once the data frame arrives 
in the area of the destination, the last stage involves rout- 
ing the data frame to the destination port, while remain- 
ing within the destination area. 

Data frames are only routed between ports that are 
in a common region, using the service class and data 
rate supported by the region. Thus, some restrictions are 
placed on the manner in which port addresses can be 
assigned in view of the fact that data frames routed within 
any particular domain or area must remain within the 
domain or area. Referring to Fig. 7(c), an example is pro- 
vided to assist in illustrating the restrictions placed on 
address assignments. In Fig. 7(c), fabric elements 52 
and 57 are each part of a common region R3. However, 
there is no direct communication link between these two 
fabric elements, and any data frame routed between 
them must pass through fabric element 55. In view of the 
requirements discussed above, fabric elements 52 and 
57 cannot be grouped within the same domain or area 
unless fabric element 55 is also included in that domain 
or area, because otherwise data frames routed between 
fabric elements 52 and 57 would not stay within a single 
domain or area. Generally stated, no two fabric elements 
that belong to a common region should be grouped in a 
single domain or area unless there is a path between 
them that is both part of the same region (or extended 
region)* and the same domain or area. Furthermore, 
each fabric element is restrained to being within a single 
domain, but may span multiple areas within the domain. 
Domains and areas may span multiple regions, as long 
as the above-described restriction is satisfied. 

As discussed above, the address partitioning 
scheme of the present invention begins by designating 
a single master fabric element as the MDAM, and by the 
master assigning addresses to its ports. All the other fab- 
ric elements in the system receive addresses for assign- 
ment to their ports in response to a request for 
addresses. Each request includes the region_IDs of the 
ports to which the addresses will be assigned. This infor- 
mation is used to ensure that the restriction discussed 
above regarding ports within a common domain or area 
being connected by at least one path through a single 
region is satisfied. To further assist in ensuring that this 
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restriction is satisfied, the MPAM for each area includes 
a list of all region J Ds for ports that have been assigned 
an address within that area, and the MAAM for each 
domain includes a list of all region_IDs for the ports that 
have been assigned an address in that domain. 

If a fabric element requests an assignment of 
addresses within the same domain or area as its adja- 
cent fabric element, a check is done to ensure that the 
above-described restriction is not violated. The request 
is initially processed by the adjacent fabric element 
whose newly assigned addresses prompted the request. 
That fabric element compares the list of region_IDs for 
the requester with its own. If the requester's regionJDs 
do not include any regions other than those included in 
the adjacent fabric element that processes the request, 
it is ensured that the above-described restriction will not 
be violated, because a communication path necessarily 
exists between the adjacent fabric elements in each of , 
the requested regions. Therefore, if the requested 
number of addresses is available in the designated 
domain or area, the request will be granted by the MAAM 
or MPAM for the domain or area. If the MAAM or MPAM 
resides in the adjacent fabric element it will simply han- 
dle the request by selecting the available addresses and 
forwarding them to the requesting fabric element. If the 
appropriate address manager is not implemented in the 
adjacent fabric element, that fabric element forwards the 
request to the address manager in the manner described 
below. 

If the comparison in the adjacent fabric element of 
its region_IDs with those of the address requester indi- 
cates that the requester seeks addresses for any region 
that is not supported by the adjacent fabric element, 
these regionJDs are forwarded along with the request 
to the appropriate address manager. The address man- 
ager for a domain or area includes a list of all regions to 
which addresses in the domain or area have previously 
been assigned. If a fabric element that requests 
addresses within an existing domain or area includes a 
new region to which no addresses in the domain op area 
has previously been assigned, the request WiH be 
granted rf the requested number of addresses is availa- 
ble. However, if the requester includes a region that is in 
the master's list, but that is not supported by the fabric 
element adjacent the requester, the request will be 
denied because no path would exist between at least one 
of the requester's ports and an existing port that is in the 
same region and the requested domain or area. Thus, 
the requester is assigned addresses within a new 
domain. 

As should be appreciated from the foregoing, 
requests for addresses within an existing domain or area 
are directed to the requester's adjacent fabric element, 
so that the regionJDs of the requester can be checked 
against those of its adjacent fabric element. 

When a fabric element seeks addresses within a 
new domain, the above-described checking need not be 
performed. A request for a new domain is directed to the 
DAM of the adjacent fabric element whose newly 
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assigned addresses prompted the request Every DAM 
stores the address of the MDAM. Therefore, when a DAM 
receives a request for addresses in a new domain, it 
directs the request to the MDAM. Each of the established 
DAMs periodically polls the MDAM to ensure that it 
remains active. K it is detected that the MDAM has 
become inactive, a new MDAM is established. Similarly, 
the AAMs and PAMs respectively poll the MAAM and 
MPAM to ensure that they remain active, and if either 
becomes inactive, a new one is established. 

The address managers are assigned fixed 
addresses so that an address request directed to a par- 
ticular address manager can be routed to that address 
manager if it is not implemented in the fabric element 
that initially receives the request. As shown in Fig. 12, 
the domain address managers are assigned hexidecimal 
addresses at FFFC (domainJD). Thus, a request for 
new addresses within any domain can be routed to the 
appropriate domain address manager from any fabric 
element in the system. The area address managers 
within any domain are assigned hexidecimal addresses 
FFFD (area_ID). The area address managers with any 
domain can only be accessed from a port address that 
is within that domain. The port address managers within 
any area are assigned hexidecimal address FFFE 
(port JD), and can similarly only be accessed from a port 
having an address within the appropriate area. The 
above-described specific address assignments for the 
domain, area and port address managers are provided 
merely for illustrative purposes, and it should be under- 
stood that other address assignments can alternatively 
be provided. The assignment of unique addresses to the 
address managers enables them to be accessed from 
any fabric element in the system. 

Fig. 14 is a block diagram of an illustrative fabric ele- 
ment 132. The fabric element has a plurality of ports, 
including an F__Port 134 for connection to a device 136 
via an N_Port 138, and a plurality of E_Ports 140, one 
of which is shown as being connected to another fabric 
element 142 via an IEL 144. The fabric element 132 
includes a cross-point switch 146 for switching between 
its ports. The switch 1 46 is connected to an element con- 
troller 148 via a switch interface 150. The element con- 
troller includes a processor 152 that is connected to a 
program memory 154 and a memory 156 via a bidirec- 
tional bus 158. The processor can be an Intel i960 proc- 
essor, or one of a variety of other processors. The 
element controller 148 also includes a timer 160 for 
implementing various timing functions, an ethernet inter- 
face 1 62 for connection to a local area network (LAN) to 
allow for remote access, and a serial interface 164 for 
connection to an operator console 166. 

As discussed above, the DSP procedure and the 
address partitioning techniques of the present invention 
are implemented by the fabric elements that are dis- 
bursed throughout the system. These techniques can be 
implemented in one or more software programs stored 
in the program memory 154, and executed on the proc- 
essor 152, within each fabric element controller 148. 



Jt should be understood that various changes and 
modifications of the embodiments shown in the drawings 
and described in this specification may be made within 
the scope of the invention. For example, although the 

5 DSP procedure and the address partitioning techniques 
are described above as being implemented in a system 
of fabric elements, it should be understood that these 
techniques can be also employed with systems having 
other types of distributed components, such as other 

io types of switches or devices. It is intended that all matter 
contained in the above-description and shown in the 
accompanying drawings be interpreted in an illustrative 
and not in a limiting sense. 

is Claims 



A method for configuring a system including a plu- 
rality of interconnected components (2, 4.. 6;. 51 -57; 
132), each component supporting service parame- 
ters used in communicating with other components 
in the system, the plurality of components including 
at least two components whose corresponding serv- 
ice parameters differ, the method comprising the 
steps of: 

A. determining which components support 
service parameters that are compatible for com- 
munication across the system; and 

B. identifying groups of components that have 
compatible service parameters. 

The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 1 , further including the steps 
of: 

C. determining whether the service parameters 
supported by every component in at least one 
group are identical; and 

D. when the service parameters for ev^ry com- 
ponent in the at least one group are not identi- 
cal, modifying the service parameters for at 
least one component in the at least one group 
so that the service parameters supported by 
every component in the at least one group are 
identical. 

The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 1 , wherein the components 
are interconnected via links (20, 22, 24), each link 
supporting service parameters used in transferring 
information between two components, and wherein 
the method further includes the steps of: 

C. determining which components within each 
group are interconnected by at least one path 
of links and components that supports the serv- 
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ice parameters that are compatible for every 
component in the group; and 
D. identifying regions (R1, R2) of components 
within 'each group that are interconnected by at 
least one path of links and components that sup- s 
ports the service parameters that are compati- 
ble for every component in the group. 

4. The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; w 
132) as recited in claim 1, wherein the components 

are interconnected according to a fabric topology, 
and wherein: 

step A includes determining which components 15 
support at least a first set of service parameters 
that are compatible, the first set defining service 
parameters that are compatible for every com- 
ponent in a single fabric; and 

20 

step B includes identifying groups of compo- 
nents supporting compatible first sets of param- 
eters, each group identifying a separate fabric. 

5. The method for configuring a system including a plu- 25 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 3, wherein the components 
are interconnected according to a fabric topology, 
and wherein the method further includes the steps 

of: 30 

E. establishing a set of fabric-wide service 
parameters that define a set of compatible serv- 
ice parameters for every component in a single 
fabric, compatibility for the set of fabric-wide 35 
service parameters for a first pair of compo- 
nents connected via a link (20, 22, 24) that sup- 
ports the set of fabric-wide service parameters 
being insufficient to ensure communication 
between the first pair of components; and 40 
E establishing a set of region-wide service 
parameters that define a set of compatible serv- 
ice parameters for every component in a single 
region, compatibility for the sets of fabric-wide 
and region-wide service parameters for a sec- 45 
ond pair of components connected via a link (20 , 
22, 24) that supports the sets of fabric-wide and 
region-wide service parameters being sufficient 
to ensure communication between the second 
pair of components; and wherein: so 

step A includes determining which compo- 
nents support service parameters that are 
compatible for the set of fabric-wide service 
parameters; ss 

step B includes identifying groups of com- 
ponents whose sets of fabric-side service 



parameters are compatible, each group 
identifying a separate fabric; 

step C includes determining which compo- 
nents within each group are interconnected 
by at least one path of links and compo- 
nents that supports the group's set of com- 
patible fabric-wide service parameters and 
further supports compatible sets of region- 
wide service parameters; and 

step D includes identifying regions of com- 
ponents within each group that are inter- 
connected by at least one path of links and 
components that supports the group's set 
of compatible fabric-wide service parame- 
ters and further supports compatible sets of 
region -wide service parameters. 



The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 1, wherein step B includes 
identifying each group of components having com- 
patible service parameters with a common group 
name. 

The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 6, wherein each component 
has a unique identification name, and wherein step 
B further includes identifying each group of compo- 
nents having compatible service parameters by 
adopting the unique identification name of one of the 
components in the group as the common group 
name. 

The method for configuring a system including a plu- 
rality of interconnected components (2, 4, 6; 51-57; 
132) as recited in claim 7, wherein step B further 
includes the steps of: 

assigning each component has name priority; and 
adopting as the common group name the unique 
identification name of a component in the group that 
has the highest name priority. 

A device (2, 4, 6; 132) for automatically configuring 
a system formed by interconnecting the device (2, 
4, 6; 1 32) with a plurality of other devices, the device 
and each of the plurality of other devices supporting 
service parameters used in inter-device communi- 
cation, the device comprising: 
an input port (8, 10 18; 140) for receiving infor- 
mation specifying the service parameters supported 
by at least one of the plurality of other devices; and 
a processor (152) programmed to determine 
whether the at least one of the plurality of other 
devices supports service parameters that are com- 
patible with the service parameters supported by the 
device. 
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